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Abstract — We show that the performance of relay selection 
can be improved by employing relays with buffers. Under the 
idealized assumption that no buffer is full or empty, the best 
source-relay and the best relay-destination channels can be 
simultaneously exploited by selecting the corresponding relays 
for reception and transmission, respectively. The resulting relay 
selection scheme is referred to as max-max relay selection 
(MMRS). Since for finite buffer sizes, empty and full buffers 
are practically unavoidable if MMRS is employed, we propose a 
hybrid relay selection (HRS) scheme, which is a combination of 
conventional best relay selection (BRS) and MMRS. We analyze 
the outage probabilities of MMRS and HRS and show that both 
schemes achieve the same diversity gain as conventional BRS and 
a superior coding gain. Furthermore, our results show that for 
moderate buffer sizes (e.g. 30 packets) HRS closely approaches 
the performance of idealized MMRS and the performance gain 
compared to BRS approaches 3 dB as the number of relays 
increases. 

I. Introduction 

In cooperative networks with multiple relays JT], where a 
number of relays assist a source in transmitting information 
to a destination, relay selection techniques have gained a 
lot of interest 0. Relay selection is attractive because of 
its high performance, efficient use of power and bandwidth 
resources, and simplicity. For example, simple relay selection 
schemes can achieve the same diversity order as more 
complex cooperative schemes employing space time block 
coding [3] or orthogonal channels [ 1 1 . Many different schemes 
for single relay selection have been proposed in the literature, 
see e.g. 0, J3)-[|6| and references therein. All these schemes 
have in common that the selected relay receives a packet from 
the source and retransmits it to the destination. The two most 
common schemes are the bottleneck and maximum harmonic 
mean based best relay selection (BRS) schemes and their 
performances have been extensively studied in the literature 
0, 0-121. Here, we adopt bottleneck based BRS as a 
benchmark for the proposed schemes. 

In order to overcome the limitations imposed by using the 
same relay for reception and transmission, we propose to 
employ relays with buffers for applications that are not delay 
sensitive. If the relays have buffers, the relays with the best 
source-relay channel and the best relay-destination channel 
can be selected for reception and transmission, respectively. 
The corresponding selection scheme is referred to as max-max 
relay selection (MMRS). For MMRS, we make the idealistic 
assumption that the buffer of the relay selected for reception 
(transmission) is not full (empty), which is only possible 
for buffers of infinite size. For the practical case of finite 
buffer sizes the buffer of a relay may become empty (full) 
if the channel conditions are such that the relay is selected 



repeatedly for transmission (reception) but not for reception 
(transmission). 

To overcome this limitation, we propose a hybrid relay 
selection (HRS) scheme, which is a combination of con- 
ventional BRS and MMRS. In particular, for HRS, if the 
buffer of the relay selected for reception (transmission) is 
full (empty), BRS is employed; otherwise, MMRS is used. 
Although both MMRS and HRS can be combined with both 
amplify-and-forward and decode-and-forward (DF) relaying, 
in this paper, we only consider DF relays and derive the 
corresponding outage probabilities. Analytical and simulation 
results establish the superiority of MMRS and HRS compared 
to BRS. 

We note that relays with buffers have been considered before 
in iflOl and ifTTI to improve the throughput of simple three- 
node networks consisting of a source, a destination, and a 
single relay. However, to the best of our knowledge, relays 
with buffers have not been considered in the context of relay 
selection before. 

The remainder of this paper is organized as follows. In 
Section |IIJ the system model is presented, and MMRS and 
HRS are introduced. An outage analysis of MMRS and HRS 
is provided in Section fUTl In Section ITVl numerical results are 
presented, and conclusions are drawn in Section [V] 

II. System model and relay selection 

In this section, we present the system model, briefly review 
BRS, and introduce the proposed MMRS and HRS schemes. 

A. System Model 

We consider a relay network with one source node, S, 
one destination node, D, and N half-duplex DF relays, 
Ri, . . . , Rn ■ Each relay is equipped with a buffer and trans- 
mission is organized in two time slots. In the first time slot, 
the relay selected for reception receives a packet from the 
source node and stores it in its buffer. In the second time slot, 
the relay selected for transmission forwards a packet from its 
buffer to the destination node. 

We assume that a direct link between the source and 
the destination does not exist or, if it does exist, it is not 
exploited for simplicity of implementation. Let gi and hi, 
i = 1,...,N, denote the S-Ri and R4-D channel gains, 
respectively. We assume that the channel coefficients gi and 
hi are mutually independent zero-mean complex Gaussian 
random variables (Rayleigh fading) with variances o^. and 
u\., respectively. Moreover, we assume that the transmission 
is organized in packets and the channels are constant for 
the duration of one packet and vary independently from one 
packet to the next (block fading model). This behavior can 



be achieved through frequency hopping between packets. Let 
7 9i = |Si| 2 ^- denote the instantaneous signal-to-noise ratio 
(SNR) between the source and relay Ri and 7^ = |/ii| 2 ^ 
the instantaneous SNR between i?j and the destination. Here, 
E s is the energy available at the transmitting nodes and N is 
the variance of the zero mean additive white Gaussian noise 
(AWGN) at the receiving nodes. ■y 9i and 7/^ are exponentially 
distributed with parameters l/ 7 y 9i and 1/7^, respectively, 
where 7 fii 4 £[ 7ffi ] = <fj , 7^ = ^] = , and 

denotes expectation. 
We assume that the destination node has perfect channel 
state information (CSI) and selects the relays for transmission 
and reception. The destination node feeds back the information 
about the selected relays to all relays via an error-free feedback 
channel. 

B. Best Relay Selection 

The BRS scheme achieves full diversity by selecting one 
relay out of the N available relays. This relay is then used for 
reception and transmission. The selected best relay, Rb, has 
the best bottleneck link J2], i.e, 

b = argmax i=li ^ min{7 gi , j hi }. (1) 

C. Max-Max Relay Selection 

The relay selected according to the criterion in (H) may not 
simultaneously enjoy the best source-relay and the best relay- 
destination channels. If the relays are equipped with buffers, 
they can store the packets received from the source and do not 
have to re-transmit them immediately in the next time slot. As 
a result, it is possible to use the relay with the best source- 
relay channel for reception and the relay with the best relay - 
destination channel for transmission. Thus, in the resulting 
MMRS scheme, the best relay for reception, Rb r , is selected 
based on 

br = argmax i=lj _ >N j 9i (2) 

and the best relay for transmission, Rbt, is selected according 
to 

bt = axgmax i=lj _ jJV j hi - (3) 

For MMRS to work properly, the buffer of no relay can be 
empty or full at any time such that all relays have always 
the option of receiving and transmitting. Clearly, for buffers 
of finite size this may not be possible since a buffer may 
become empty (full) if a relay enjoys repeatedly the best relay- 
destination (source-relay) link but never the best source-relay 
(relay-destination) link. To overcome this problem, in the next 
subsection, we combine MMRS with BRS. 

D. Hybrid Relay Selection 

If buffer over- and underflows are to be avoided, the relay 
selection criterion cannot only depend on the channel status 
as in MMRS but also has to take into account the status of 
the buffer. The basic idea is to use BRS if either the buffer 
of the relay selected for reception is full or the buffer of the 
relay selected for transmission is empty. In all other cases, 



MMRS is used. We assume that all buffers have Lb elements 
and each element can store one packet. We denote the number 
of elements of relay R/s buffer that are full by N e ^. For HRS, 
the best relay for reception, R^, is selected according to 

r- _ f b, if N e . br = L b - 1 or 7V e ,6t = 0, 
[ br, otherwise, 

and the best relay for transmission, Rj—, is selected according 

g£ = f b, if N eM = L b -l or N eM = 0, 
1 bt, otherwise, 

where b, br, and bt are defined in (Q~|i, (|2), and (01, respectively. 
In (0]i and (O, we always leave one element of each buffer 
empty so that each relay is always able to receive in case 
it is selected for reception in the BRS mode in the next 
transmission interval. 

We note that for both MMRS and HRS, since different 
packets may be stored at different relays for different amounts 
of time, the packets transmitted by the source may arrive 
at the destination node in an order different from the order 
at the source node. The original order can be restored at 
the destination node if the order information is contained 
in the preamble of the packet. Furthermore, MMRS and 
HRS introduce a delay in the network. This issue will be 
investigated in Section [IV] 

III. Outage Probability Analysis 

In this section, we study the outage probability of MMRS 
and HRS with DF relays. The outage probability is defined 
as the probability that the output SNR, 7^, falls below a 
certain SNR threshold, 7 = 2 2R — 1, above which error-free 
transmission with rate R is possible ifPH . i.e., 

Pout = P{lb < 7), (6) 

where P(A) denotes the probability of event A. Before we 
consider MMRS and HRS, we first briefly review the outage 
probability of BRS, which will be useful for computation of 
the outage probability of HRS. 

A. Best Relay Selection 

For BRS and DF relays, 7b = max,{min(7 9i ,7/ li )}. Thus, 
based on we obtain J7) 

^=n(l-exp (-£)), (7) 

where y t = (l/j 9i + l/jhi)~ ■ 

At high SNR and assuming independent and identically 
distributed (i.i.d.) fading for both links, i.e., j g . = 7^. = 7 
and yi = \, the outage probability can be simplified to 

P^*(jfj". (8) 

Expressing the outage probability now in terms of the diversity 
gain Gd and coding gain G c , i.e., P out « (G c ^/j)~ Gd Q31, 
we observe that the diversity gain of BRS is G^ RS = N and 
its coding gain is Gf RS = 1/2. 



B. Max-Max Relay Selection 

For MMRS and DF relays, we have 7b = min{7 ffii , jh b }, 
where 7 fft = maxj = i...jv 7s» and IK = maxi=i...jv 7hi ■ 
Hence, the outage probability is given by 
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In case of i.i.d. fading for both links, i.e., 7 
i = 1,...,N, (0 simplifies to 
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(10) 



If we assume furthermore that the SNR is high and use the 
approximation 1 — e~ x w x, x — > 0, we obtain 
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From (fTTT i. we observe that MMRS achieves a diversity gain 
of Gf MRS = N and a coding gain of Gf MRS = 2'* . 
Thus, in contrast to BRS, the coding gain of MMRS increases 
with the number of relays. 

Interestingly, BRS and MMRS have the same diversity gain. 
However, MMRS achieves a higher coding gain for N > 2 
relays. For a large number of relays, MMRS yields an SNR 
gain of limAT^oo 10 log 10 (Gf MRS /Gf RS ) = 3 dB compared 
to BRS. 

C. Hybrid Relay Selection 

For simplicity, for the analysis of HRS, we only consider 
the i.i.d. fading case. Considering (|4]i and (0, the outage 
probability of HRS can be written as 
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p nUMRS 
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(12) 



where Pbrs and Pmmrs = 1 — Pbrs are the probabilities 
that BRS (i.e., br = bt = b) and MMRS (i.e., br = br and bl = 
bt) are used in HRS, respectively. Since Pf R s and P^ RS 
are already known from the previous two subsections, we only 
have to compute Pbrs ( or Pmmrs) for evaluation of P^ u f s ■ 
Clearly, if all the buffers are either full or empty, BRS is 
used all the time and Pbrs = 1 (and hence Pmmrs — 0). In 
order to compute Pbrs f° r the more interesting case where 
at least one buffer is neither full nor empty, we model the 
possible states of the buffers and the transitions between the 
states as a Markov chain. Let Si = XiX2---Xn denote 
the ith state in the Markov chain, where Xj, j = 1 , . . . , N, 
represents the number of full elements in the jth buffer. Let 
Pbrs,i denote the probability of using BRS in state Si. Then, 
Pb rs can be written as 



P 



BRS 



E 

i=l 



PBRS,iPSi , 



(13) 



where Ps i and N s denote the probability of being in state Si 
and the total number of states, respectively. Since the buffer 
size is finite and the total number of buffer elements across 
all relays that are full is constant, each state has to meet the 
following two constraints 
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£ 

i=l 



Xi = N e , 
0<X t <L h -l, i£ {!,..., N}, 



(14) 



(15) 



where N e = J2iLi N e ,i is the total number of full elements 
of all buffers. 

The probability of transition from one state to another state 
is 1/N 2 . This can be seen from the fact that for a two-hop 
relay network with N relays there are TV 2 possible selections 
of the relays for reception and transmission. Since we assume 
that all channels are i.i.d., the probability of each selection is 
1/N 2 . Given that the status of the buffers changes only if the 
relays selected for reception and transmission are different, 
each transition from one state to another state corresponds 
to only one selection, resulting in a transition probability of 
1/N 2 . On the other hand, if any one of the N available 
relays is selected for reception and transmission, the states of 
the buffers remain unchanged. Thus, there is more than one 
selection that allows the buffers to remain in the same state 
and the probability that the buffer remains in the same state 
is generally larger than 1/N 2 . 

Proposition 1: The state transition matrix P of the Markov 
chain that models the buffer states is a doubly stochastic 
matrixQ- 



Pij 



Proof: For any Markov chain Pij = 1 holds, where 

= [P]ij is the transition probability from state S, to 
state Sj. Furthermore, for the considered case, all transition 
probabilities from one state to another state are equal to 1/N 2 . 
If there is a transition from state Si to state Sj, there is also a 
transition from state Sj to state Si and the probability of both 
transitions is 1/N 2 . Thus, the transition matrix P is symmetric 
and ^2iLi Pij = 1 holds. Hence, the transition matrix is doubly 
stochastic, and the proof is complete. ■ 
Lemma 1 ( IH4\ Page 65]): For a doubly stochastic transi- 
tion matrix, the stationary distribution is uniform, i.e., all the 
states are equally likely. For an N s -state Markov chain, the 
probability of being in state Si, i = 1, . . . , N s , is Ps\ = t^-, 
regardless the initial state. 
From Lemma Q] (TOI ) reduces to 
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BRS 



1 Ns 

w Y1 Pbr ^ 



(16) 
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Since the computation of Pbrs,l is difficult in the general 
case, we first consider an example to illustrate the main idea. 

Example 1: Let us consider a relay network with N = 2 
relays and the buffer at each relay is of size Lf, = 4 and half 
of the buffer elements are full, i.e., N e = 4. Fig. Q] depicts the 

'A doubly stochastic matrix is a square matrix for which the sum of the 
elements in each of its rows and columns is 1 1141 . 
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Fig. 1 . Relay network with one source, one destination, and two relays where 
each relay is equipped with a four-element buffer. 




Fig. 2. State diagram of the Markov chain representing the states of the 
buffers and the transitions between them. 



block diagram of the network. The states of the corresponding 
Markov chain have to satisfy the constraints in (fT4t and (Q3), 
i.e., 



Xi + X 2 = 4, X x < 3, and X 2 < 3. 



(17) 



Therefore, we have N s = 3 possible states for the Markov 
chain, XiX 2 G {13,22,31}, and the probability of transition 
from one state to another is = \- Let Si = 13, S 2 = 22, 
and 53 = 31. The state diagram of this Markov chain is shown 
in Fig. |2] The corresponding state transition matrix is given 
by 



3/4 1/4 
1/4 1/2 1/4 
1/4 3/4 



(18) 



As expected, the transition matrix P is doubly stochastic. 
Therefore, from Lemma Q] the probability of each state is 



1 

N, 



Let us now define matrix D = 



where the 



oi bi 
a 2 b 2 

first and second column represents the relays selected for 
reception and transmission, respectively. If a* = 1, relay B4 
is selected for reception and if bi = 1, relay B4 is selected 
for transmission, otherwise both a, and bi are zero. Note that 
since only one relay is selected for reception and transmission, 
respectively, in each column of D only one element is equal 
to one and all other elements are zero. Hence, D can assume 
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D, 



4 different values: Di 



and D4 = 



D 2 



and the probability of 



occurrence of each value is = |. Now, we are ready to 
compute Pbrs,i f° r eacn state. 

1) State Si = 13: For Di and D 3 , based on © and © 
MMRS is used, and hence P BRS 1 = P B rs 1 = 0- For 
D2 and D4, again based on (HJi and ((5), BRS is used, 
and hence P| flSa = P B rs,i = w = \- Summing up 
the probabilities of using BRS in state Si, we obtain 

Pbrs,i = Z)i=l p brs,i = 2- 

2) State 5 2 = 22: In this case, Pbrs,2 = 0, since the 
buffers are neither full nor empty. 

3) State S3 = 31: This state is symmetric to state Si. Thus, 

Pbrs,3 = 2 - 

Finally, the total probability of using BRS is obtained as 



Pbrs = j^- Pbrs 



U 1, 
3 ( 2 + 2 } 



(19) 



Let us now return to the general case. 

Proposition 2: Let N F i, and Ne % denote the number of 
full and empty buffers for state Si, respectively. Note that the 
buffer of relay Ri is considered full if N e / t = Lf, — 1. Then, 
the probability of using BRS in state Si is given by 

P B RSa = -^((N F ,i + N E ,i)N -N F ,iN E ,i). (20) 

Proof: As mentioned before, for N relays, there are 
A^ 2 possible selections of the relays for reception and trans- 
mission and the probability of each selection is 1/N 2 . 
Therefore, according to (0) and (0, if we have Np full 
buffers in state Si, there are Np^N selections for which 
BRS is used. Moreover, if sate Si has Ne,% empty buffers, 
from the remaining A 2 — Np,iN possible selections, there 
are (N — Nf^Nej selections in which BRS is used. 
Therefore, since each selection has a probability of occur- 
rence of 1/N 2 , the probability of using BRS in state Si 
is given by: P BRS4 - (Np^N + (N — Np,i)N E: i) = 
772 ((Npj + N E ,i)N - N Fti N E ,i) ■ This concludes the proof. 

■ 

Computation of N s , Np^, and Ne,i- For computation of 
Pbrs, the number of possible buffer states, N s , has to be 
determined. It does not seem possible to obtain a general 
formula for N s valid for any A, Lf,, and A^. However, for 
N = 2 and N = 3, the number of states can be calculated in 
closed form. In particular, for N = 2, we obtain 

' N e + 1, if N e < L b - 1 
2Lb — N e — 1, otherwise 



A s 



(21) 



and, for N = 3, we have 



JVe + l 



i=(JV, 



L b )++1 



i-2{i-L b )+y 



(22) 



where (x) + = max{a;,0}. 

For the general case, for a given total number of full buffer 
elements, N e , and a given size of the buffers, Lb, the number 
of states can be obtained algorithmically as the number of all 
possible combination of XiX 2 ...Xm that satisfy (fl4b and ( fT5l ). 
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Fig. 3. Outage probability vs. buffer size, Lj, for N = 2 and N = 3 relays. 
Half of the buffer elements are full, i.e., N e = \NL b /2\, SNR = 20 dB, 
and the target rate is R = lbit/sec/Hz. The analytical results were obtained 
from 0, (§), and {HI . 



Fig. 4. Outage probability vs. average number of full buffer elements per 
relay for N = 2 and N = 3. L b = 100, SNR = 20 dB, and the target rate 
is Ft. = lbit/scc/Hz. The analytical results were obtained from Q, (9), and 

{HJ. 



Given the states of the Markov chain, it is easy to obtain 
the number of empty and full buffers, Ne.% and Nf,u f° r eacn 
state Si, i = 1,...,N S . Thus, Prrs can be computed based 
on (dSJl and d20l 

Computation ofP? u RS : Given P® RS ©, P^ lt MRS ©, and 
Pbrs, P^i RS can be computed using Sl2\ . 

In the asymptotic case of high SNR, the outage probability 
of HRS can be expressed as 

P H J S ^^(2P M MRS + 2 N P BRS ) v lj . (23) 

Therefore, the diversity gain of HRS is G^ RS = N and 

the coding gain is Gf RS = (2P M mrs + 2 N P BRs y^, i.e., 
the coding gain of HRS increases with increasing TV and 
increasing Pmmrs- 

IV. Numerical results 

In this section, we assess the performance of the proposed 
MMRS and HRS schemes and compare it with that of BRS 
|2). Throughout this section, a target rate R = lbit/sec/Hz is 
assumed for outage probability calculation. Furthermore, we 
consider the i.i.d. case where all the channel coefficients are 
modeled as zero-mean complex Gaussian random variables 
with variance = a\. = 1, and, hence j gi = j h . = 7 = 
f* = SNR. 

Fig. [3] shows the outage probability vs. the buffers size, L^, 
for N = 2 and N = 3 relays and SNR = 20 dB. We assume 
that half of the buffer elements are full, i.e., N e = \NL b /2], 
where \x] denotes the smallest integer larger than or equal to 
x. Fig. [3] shows that for buffers of size Lb = 1 HRS behaves 
like BRS. As the buffer size increases, the performance of 
HRS converges to that of MMRS. In fact, for L b > 10 and 
Lb > 30 HRS achieves a performance very similar to that of 



MMRS for N = 2 and N = 3, respectively. We also note 
that the analytical results obtained based on the derivation in 
Section|Ill]are in perfect agreement with the simulation results. 

In Fig. 2] we investigate the impact of the average number 
of full buffer elements per relay on the outage probability of 
HRS. We consider buffers with L b = 100 elements and assume 
again SNR = 20 dB. As can be observed, the best performance 
is achieved if the buffers are half full on average, i.e., the total 
number of full buffer elements is N e = \NLb/2~\. In this case, 
the probability of having empty or full buffers is minimized 
and the probability that MMRS is used is maximized. 

Fig. [5] depicts the outage probability of MMRS, HRS, and 
BRS vs. the average SNR for various numbers of relays. For 
HRS, the buffer size is Lb = 30 and half of the buffer elements 
are full. As expected, all considered relay selection schemes 
achieve a diversity gain of Gd = N. However, the coding 
gain advantage of MMRS and HRS increases with increasing 
number of relays. For N = 1, MMRS and HRS are identical to 
BRS (in fact, no selection takes place in this case). For N = 2, 
3, and 5, the asymptotic SNR gain of MMRS compared to 
BRS is 1.5 dB, 2.0 dB, and 2.4 dB, respectively. The gap 
between MMRS and HRS increases slightly with increasing 
N indicating that the buffer size has to increase with increasing 
N to keep the gap between MMRS and HRS constant. 

In Fig. [6] we investigate the effect of the relay buffer size, 
Lb, on the average delay introduced by HRS. Half of the 
buffer elements are full, i.e., N e = \NL b /2], and SNR = 
15 dB. The delay is zero if the packet is not stored at the 
relay and reaches the destination in two consecutive hops as 
in BRS. The delay in Fig. [6] corresponds to the number of 
transmission interval durations (corresponding to two hops and 
consequently two packet durations) that a packet is stored 
at a relay before it arrives at the destination, i.e., a delay 
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Fig. 5. Outage probability of MMRS, HRS, and BRS vs. average SNR 
for different numbers of relays. For HRS, the buffer size is = 30 and 
half of the buffer elements are full, i.e., N e = \NL},/2\. The target rate is 
R = lbit/sec/Hz. Analytical results obtained from (|7j, {9), and d I — I are 
shown. 

of one means that the packet is stored at the relay in one 
transmission interval and retransmitted in the next. Fig. |6] 
shows that, as expected, the average delay increases with 
increasing buffer size. In fact, for sufficiently large buffer 
sizes the average delay can be approximated as NLb/2. Thus, 
considering the results in Figs. [3] and [5] delays of less than 50 
(100) transmission intervals are sufficient for HRS to closely 
approach the performance of MMRS for N = 3 (N = 5) 
relays. 

V. Conclusion 

In this paper, we proposed two new relay selection schemes 
for relays with buffers. The first scheme, MMRS, always 
selects the relays with the best source-relay and the best relay- 
destination channels for reception and transmission, respec- 
tively, and operates under the assumption that the buffers at 
the relays are neither full nor empty. Since this assumption is 
not practical for finite buffers, we proposed a second scheme, 
HRS, which employs MMRS if the buffer of the relay selected 
for reception is not full and the buffer of the relay selected for 
transmission is not empty, and conventional BRS otherwise. 
We have analyzed the outage probability of MMRS and HRS 
and established that while they have the same diversity gain 
as BRS, they achieve a coding gain advantage of up to 3 dB. 
More importantly, we showed that, for N — 3 relays, HRS can 
achieve a coding gain advantage of 2 dB compared to BRS if 
an average delay of 50 transmission intervals can be afforded. 

Finally, we note that relays with buffers add additional 
flexibility to cooperative diversity systems. While, in this 
paper, we used this flexibility to improve the performance 
of relay selection, exploring other scenarios (e.g. interference 
avoidance) where relays with buffers may be advantageous in 
cooperative networks is an interesting topic for future work. 




Buffer size 

Fig. 6. Average delay vs. buffer size Lj, for HRS. Half of the buffer elements 
are full, i.e., N e = \NL b /2\, SNR = 15 dB, and the target rate is R = 
lbit/scc/Hz. Simulation results are shown. 
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